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(57) Abstract: A method of synthesizing a first (L) and a second (R) output signal from an input signal (x). The method comprises: 
filtering (201) the input signal to generate a filtered signal; obtaining a correlation parameter indicative of a desired correlation 
between the first and second output signals; obtaining a level parameter (c) indicative of a desired level difference between the first 
and second input signals; and transforming the input signal and the filtered signal by a matrixing operation (203) into the first and 
second output signals, where the matrixing operation depends on the correlation parameter and the level parameter. 
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Signal synthesizing 



This invention relates to the synthesizing of a first and a second output signal 
from an input signal. 

5 Within the field of audio coding, parametric audio coders have gained 

increasing interest. It has been shown that transmitting (quantized) parameters that describe 
audio signals requires only little transmission capacity and that they allow a decoding at the 
receiving end which results in an audio signal that perceptually does not significantly differ 
from the original signal. Hence, bit-rate savings may be obtained by only transmitting one 
10 audio channel combined with a parameter bit stream that describes the spatial properties of 
the stereo signal and, thus, allows a decoder to reproduce the spatial properties of the stereo 
signal. 

One of the above spatial parameters which is of importance for the coding of a 
stereo signal comprising an L channel and an R channel is the interchannel cross-correlation 

15 between the L and R channels. Hence, in many systems one of the signal parameters that are 
analysed by an encoder is the interchannel cross-correlation. The determined cross- 
correlation is then transmitted together with a mono signal from the encoder to a 
corresponding decoder. 

At the decoder two output signals are reconstructed which have the desired 

20 cross-correlation. Furthermore, it is desirable that the reconstruction only introduces little 
artifacts relative to the original stereo signal. 

Various methods of decorrelating signals are known as such. Fig. 1 illustrates 
a so-called Lauridsen decorrelator. The Lauridsen decorrelator comprises an all-pass filter 
101, e.g. a delay, which generates and possibly attenuates a delayed version of the waveform 

25 of the input signal x. The output H®x of the filter 101 is subsequently added (102) to the 

input resulting in the left channel L and subtracted (103) from the input resulting in the right 
channel R. 

The above prior art decorrelator is very suitable as long as the two output 
signals are very similar or even equal in level. However, parametric audio coders also apply 
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level differences to the output signals, the so-called amplitude panning. The above 
decorrelator involves the problem that the perceptual quality of the generated signals 
deteriorates if the level differences are large. 

5 

The above and other problems are solved by a method of synthesizing a first 
and a second output signal from an input signal, the method comprising: 
filtering the input signal to generate a filtered signal; 

obtaining a correlation parameter indicative of a desired correlation between 
1 0 the first and second output signals; 

obtaining a level parameter indicative of a desired level difference between the 
first and second output signals; and 

transforming the input signal and the filtered signal by a matrixing operation 
into the first and second output signals, where the matrixing operation depends on the 
1 5 correlation parameter and the level parameter. 

Hence, by performing a matrix operation which depends both on the desired 
correlation and the desired level difference, a significant increase in perceptual quality of the 
output signals of a parametric decoder is achieved. 

In a preferred embodiment, the matrixing operation comprises a common 
20 rotation by a predetermined angle of the first and second output signals in a space spanned by 
the input signal and the filtered input signal; and where the predetermined angle depends on 
the level parameter. 

Hence, By adding an additional rotation to the mixing operation, the relative 
level of the output signals may be controlled without influencing the cross-correlation 
25 between the output signals. 

In a further preferred embodiment, the predetermined angle is selected to 
maximize a total contribution of the input signal to the first and second output signals. It is 
realized that the perceptual quality of the signal may be increased, if the amount of the 
filtered signal present in the output signals is minimized and, thus, the amount of the original 
30 signal is maximized. 

When the method further comprises scaling each of the first and second output 
signals to said desired level difference between the first and second output signals, it is 
ensured that the relative level of the output signals corresponds to the desired level according 
to a level parameter determined by the encoder. 
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In a preferred embodiment, the filtering of the input signal comprises all-pass 
filtering the input signal, e.g. a comb-filter. The spectral spacing of a comb-filter is uniformly 
distributed over frequency. Hence to be able to obtain a desired dense spacing of peaks and 
valleys at low frequencies, the delay of the Lauridsen decorrelator should be very large. This, 
5 however, has the disadvantage that at high frequencies, echos can be perceived for transient 
input signals. 

This problem may be solved when the all-pass filter comprises a frequency- 
dependant delay. At high frequencies, a relatively small delay is used, resulting in a coarse 
frequency resolution. At low frequencies, a large delay results in a dense spacing of the comb 
10 filter. 

The filtering may be performed on the full bandwidth of the signal. 
Alternatively, the filtering may be combined with a band-limiting filter, thereby applying the 
decorrelation to one or more selected frequency bands. 

The term matrix operation refers to an operation which transforms an input 
15 multi-channel signal into an output multi-channel signal where the components of the output 
multi-channel signal are linear combinations of the components of the input multi-channel 
signal. 

The present invention can be implemented in different ways including the 
method described above and in the following, arrangements for encoding and decoding, and 

20 further product means, each yielding one or more of the benefits and advantages described in 
connection with the first-mentioned method, and each having one or more preferred 
embodiments corresponding to the preferred embodiments described in connection with the 
first-mentioned method and disclosed in the dependant claims. 

It is noted that the features of the method described above and in the following 

25 may be implemented in software and carried out in a data processing system or other 
processing means caused by the execution of computer-executable instructions. The 
instructions may be program code means loaded in a memory, such as a RAM, from a storage 
medium or from another computer via a computer network. Alternatively, the described 
features may be implemented by hardwired circuitry instead of software or in combination 

3 0 with software . 

The invention further relates to an arrangement for synthesizing a first and a 
second output signal from an input signal, the arrangement comprising: 

filter means for filtering the input signal to generate a filtered signal; 
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means for obtaining a correlation parameter indicative of a desired correlation 
between the first and second input signals; 

means for obtaining a level parameter indicative of a desired level difference 
between the first and second input signals; and 

means for transforming the input signal and the filtered signal by a matrixing 
operation into the first and second output signals, where the matrixing operation depends on 
the correlation parameter and the level parameter. 

The invention further relates to an apparatus for supplying a decoded audio 
signal, the apparatus comprising: 

an input unit for receiving an encoded audio signal; 

a decoder for decoding the encoded audio signal, the decoder comprising an 
arrangement for synthesizing a first and a second audio signal as described above and in the 
following; and 

an output unit for providing the decoded first and second audio signal. 

The invention further relates to a decoded multi-channel signal comprising a 
first and a second signal component synthesized from an input signal by transforming the 
input signal and a filtered signal by a matrixing operation into the first and second signal 
components, where the filtered signal is generated by filtering the input signal, and where the 
matrixing operation depends on a correlation parameter indicative of a desired correlation 
between the first and second input signals and on a level parameter indicative of a desired 
level difference between the first and second input signals. 

The invention further relates to a storage medium having stored thereon such a 
decoded multi-channel signal. 

These and other aspects of the invention will be apparent and elucidated from 
the embodiments described in the following with reference to the drawing in which: 
fig. 1 shows a prior art Lauridsen decorrelartor; 

fig. 2 illustrates a decorrelator according to an embodiment of the invention; 
figs. 3a-c illustrate the signal generation according to an embodiment of the 

invention; 

fig. 4 schematically shows a system for spatial audio coding; and 

fig. 5 shows a schematic view of a system for communicating multi-channel 

audio signals; 
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Fig. 2 illustrates a decorrelator according to an embodiment of the invention. 
The decorrelator comprises an all-pass filter 201 receiving an input signal x, e.g. from a 
parametric audio encoder which generates a mono audio signal x and a set of parameters P 
including an interchannel cross-correlation p and a parameter indicative of the channel 
difference c. Preferably, the all-pass filter comprises a frequency-dependant delay providing 
a relatively smaller delay at high frequencies than at low frequencies. This may be achieved 
by replacing a fixed-delay of the all-pass filter with an all-pass filter comprising one period 
of a Schroeder-phase complex (see e.g. M.R. Schroeder, "Synthesis of low-peak-factor 
signals and binary sequences with low autocorrelation", IEEE Transact. Inf. Theor., 16:85- 
89, 1970). The decorrelator further comprises an analysis circuit 202 that receives the spatial 
parameters from the decoder and extracts the interchannel cross-correlation p and the channel 
difference c. The circuit 202 determines a mixing matrix M(oc,P) as will be described in 
connection with figs. 3a-c. The components of the mixing matrix are fed into a 
transformation circuit 203 which further receives the input signal x and the filtered signal 
H®x. The circuit 203 performs a mixing operation according to 



resulting in the output signals L and R. 

Figs. 3a-c illustrate the signal generation according to an embodiment of the 
invention. In fig. 3 a the input signal x is represented by the horizontal axis while the filtered 
signal H®x is represented by the vertical axis. As the two signals are uncorrected they may 
be represented as orthogonal vectors spanning a two-dimensional space. 



respectively. In this representation, the correlation between the signals L and R is given by 
the angle a between the vectors 301 and 302 according to p=cos(a), i.e. by the angular 
distance a between the vectors 301 and 302. Consequently, any pair of vectors that exhibits 
the correct angular distance has the specified correlation. 

Hence, a mixing matrix M which transforms the signals x and H®x into 
signals L and R with a predetermined correlation p may be expressed as follows: 




(1) 



The output signals L and R are represented as vectors 301 and 302, 
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M = | 



fcos(a/2) sirKa^)^ ( 2 ) 
\cos(-a/2) sin(-a/2)/ 
Thus, the amount of all-pass filtered signal depends on the desired correlation. 
Furthermore, the energy of the all-pass signal component is the same in both output channels 
( but wit a 180° phase shift). 

It is noted that the Lauridsen decorrelator of fig. 1 corresponds to the case 
where the matrix M is given by 



'1 -n 

J -v 



(3) 



i.e. a=90° corresponding to uncorrected output signals(p=0). 

In order to illustrate a problem with the matrix of eqn. (3), we assume a 
situation with an extreme amplitude panning towards the left channel, i.e. a case where a 
certain signal is present in the left channel only. We further assume that the desired 
correlation between the outputs is zero. In this case, the output of the left channel of the 
transformation of eqn. (1) with the mixing matrix of eqn. (3) yields L = 1 / ^J2(x + H ® x) . 
Thus, the output consists of the original signal x combined with its all-passed filtered version 
H®x. 

However, this is an undesired situation, since the all-pass filter usually 
deteriorates the perceptual quality of the signal. Furthermore, the addition of the original 
signal and the filtered signal results in comb-filter effects, such as perceived coloration of the 
output signal. In this assumed extreme case, the best solution would be that the left output 
signal consists of the input signal. This way the correlation of the two output signals would 
still be zero. 

In situations with more moderate level differences, the preferred situation is 
that the louder output channel contains relatively more of the original signal, and the softer 
output channel contains relatively more of the filtered signal. Hence, in general, it is 
preferred to maximize the amount of the original signal present in the two outputs together, 
and to minimize the amount of the filtered signal. 

According to the invention, this is achieved by introducing a different mixing 
matrix including an additional common rotation: 



M-C 



f cos(P + a / 2) sin(p + a / 2) 
[cos(P - a 1 2) sin(p -a/2)) 



(4) 
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Here p is an additional rotation, and C is a scaling matrix which ensures that 
the relative level difference between the output signals equals c, i.e. 



1 + c 
0 



0 
1 



1 + cJ 



Inserting the matrix of eqn. (4) in eqn. (1) yields the output signals generated 
by the matrixing operation according to the invention: 



1 + c 



0 



0 



1 + cj 



( cos(p + a / 2) sin(p + a / 2)* 
[cos(P - a / 2) sin(p - a / 2) 



f 



x 

H®x, 



This situation is illustrated in fig. 3b. The output signals L and R still have an 
angular difference a, i.e. the correlation between the L and R signals is not affected by the 
scaling of the signals L and R according to the desired level difference and the additional 
rotation by the angle p of both the L and the R signal. 

As mentioned above, preferably, the amount of the original signal x in the 
summed output of L and R should be maximized. This condition may be used to determine 
the angle p 5 according to 



ax ' 

which yields the condition: 

tan(p) = ^-tan(a/2). 

This situation is illustrated in fig. 3 c, where the sum of the L and R 
components is aligned with the direction of x. 

Fig. 4 schematically shows a system for spatial audio coding. The system 
comprises an encoder 401 and a corresponding decoder 405. The encoder 401 describes the 
spatial attributes of a multi-channel audio signal by specifying an interaural level difference, 
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an interaural time (or phase) difference, and a maximum correlation as a function of time and 
frequency, as is described in European patent application no. 02076588.9, filed on 22 april 
2002. The encoder 401 receives the L and R components of a stereo signal as inputs. Initially, 
by time/frequency slicing circuits 402 and 403, the R and L components, respectively, are 
5 split up into several time/frequency slots, e.g. by time-windowing followed by a transform 
operation. 

In one embodiment, The left and right incoming signals are split up in various 
time frames (e.g. 2048 samples at 44.1 kHz sampling rate) and windowed with a square-root 
Harming window. Subsequently, FFTs are computed. The negative FFT frequencies are 

10 discarded and the resulting FFTs are subdivided into groups (subbands) of FFT bins. The 
number of FFT bins that are combined in a subband depends on the frequency: At higher 
frequencies more bins are combined than at lower frequencies. For example, FFT bins 
corresponding to approximately 1 .8 ERBs (Equivalent Rectangular Bandwidth) may be 
grouped, resulting in e.g. 20 subbands to represent the entire audible frequency range. 

1 5 Subsequently, in the analysis circuit 404, for every time/frequency slot, the 

following properties of the incoming signals are analyzed: 

The interaural level difference, or ILD, defined by the relative levels of the 
corresponding band-limited signals stemming from the two inputs, 

The interaural time (or phase) difference (ITD or IPD), defined by the 

20 interaural delay (or phase shift) corresponding to the peak in the interaural cross-correlation 
function, and 

The (dis)similarity of the waveforms that can not be accounted for by ITDs or 
ILDs, which can be parameterized by the maximum value of the cross-correlation function 
(i.e., the value of the cross-correlation function at the position of the maximum peak). 

25 The three parameters described above vary over time; however, since it is 

known that the binaural auditory system is very sluggish in its processing, the update rate of 
these properties is rather low (typically tens of milliseconds). 

The analysis circuit 404 further generates a sum (or dominant) signal S 
comprising a combination of the left and right signals. Hence, the L and R signals are 

30 encoded as the sum signal S and a set of parameters P as a function of frequency and time, 
the parameters P comprising the ILD, the ITD/IPD, and the maximum value of the cross- 
correlation function. 
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It is noted that parameter ILD in this embodiment is related to the channel 
difference parameter c in the embodiment of fig. 2 by ILD = k-log(c), where k is a constant, 
i.e. ILD is proportional to the logarithm of c. 

In one embodiment, for each subband, the corresponding ILD, ITD and 
correlation p are computed. The ITD and correlation are computed simply by setting all FFT 
bins which belong to other groups to zero, multiplying the resulting (band-limited) FFTs 
from the left and right channels, followed by an inverse FFT transform. The resulting cross- 
correlation function is scanned for a peak within an interchannel delay between -64 and +63 
samples. The internal delay corresponding to the peak is used as ITD value, and the value of 
the cross-correlation function at this peak is used as interaural correlation of this subband. 
Finally, the ILD is simply computed by taking the power ratio of the left and right channels 
for each subband. 

The sum signal S may be generated by summing the left and right subbands 
after a phase correction (temporal alignment). This phase correction follows from the 
computed ITD for that subband and consists of delaying the left-channel subband with ITD/2 
and the right-channel subband with -ITD/2. The delay is performed in the frequency domain 
by appropriate modification of the phase angles of each FFT bin. Subsequently, the sum 
signal is computed by adding the phase-modified versions of the left and right subband 
signals. Finally, to compensate for uncorrelated or correlated addition, each subband of the 
sum signal is multiplied with sqrt(2/(l+p)), with p the correlation of the corresponding 
subband. If necessary, the sum signal can be converted to the time domain by (1) inserting 
complex conjugates at negative frequencies, (2) inverse FFT, (3) windowing, and (4) 
overlap-add. 

Preferably, the spatial parameters are quantized to reduce the required bit rate 
for their transmission. 

The sum signal S and the parameters P are communicated to a decoder 405. 
The decoder 405 comprises a decorrelator circuit 406 which modifies the correlation between 
the left and right signals as described in connection with fig. 2. The decoder further 
comprises delay circuits 407 and 408 which delay each subband of the left signal by -ITD/2 
and each subband of the right signal by ITD/2, respectively, given the (quantized) ITD 
corresponding to that subband. The decoder further comprises circuit 409 which scales the 
subbands according to the IID for that subband and converts the output signals to the time 
domain, e.g. by performing the following steps: (1) inserting complex conjugates at negative 
frequencies, (2) inverse FFT, (3) windowing, and (4) overlap-add. 
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Fig. 5 shows a schematic view of a system for communicating stereo audio 
signals according to an embodiment of the invention. The system comprises a coding device 
501 for generating a coded audio signal and a decoding device 505 for decoding a received 
coded signal into a stereo signal. The coding device 501 and the decoding device 505 each 
5 may be any electronic equipment or part of such equipment. 

Here, the term electronic equipment comprises computers, such as stationary 
and portable PCs, stationary and portable radio communication equipment and other 
handheld or portable devices, such as mobile telephones, pagers, audio players, multimedia 
players, communicators, i.e. electronic organizers, smart phones, personal digital assistants 
10 (PDAs), handheld computers, or the like. It is noted that the coding device 501 and the 
decoding device may be combined in one electronic equipment where audio signals are 
stored on a computer-readable medium for later reproduction. 

The coding device 501 comprises an input unit 51 1 for receiving a stereo 
signal, an encoder 502 for encoding a stereo audio signal including a left signal component L 
1 5 and a right signal component R. The encoder 502 receives the two signal components via the 
input unit 511 and generates a coded signal T. The stereo signal may originate from a set of 
microphones, e.g. via further electronic equipment, such as a mixing equipment, etc. The 
signals may further be received as an output from another audio player, over-the-air as a 
radio signal, or by any other suitable means. An example of such an encoder was described in 
20 connection with fig. 4 above. 

According to one embodiment, the encoder 502 is connected to a transmitter 
503 for transmitting the coded signal T via a communications channel 509 to the decoding 
device 505. The transmitter 503 may comprise circuitry suitable for enabling the 
communication of data, e.g. via a wired or a wireless data link 509. Examples of such a 
25 transmitter include a network interface, a network card, a radio transmitter, a transmitter for 
other suitable electromagnetic signals, such as an LED for transmitting infrared light, e.g. via 
an IrDa port, radio-based communications, e.g. via a Bluetooth transceiver, or the like. 
Further examples of suitable transmitters include a cable modem, a telephone modem, an 
Integrated Services Digital Network (ISDN) adapter, a Digital Subscriber Line (DSL) 
30 adapter, a satellite transceiver, an Ethernet adapter, or the like. Correspondingly, the 

communications channel 509 may be any suitable wired or wireless data link, for example of 
a packet-based communications network, such as the Internet or another TCP/IP network, a 
short-range communications link, such as an infrared link, a Bluetooth connection or another 
radio-based link. 
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Further examples of the communications channel include computer networks 
and wireless telecommunications networks, such as a Cellular Digital Packet Data (CDPD) 
network, a Global System for Mobile (GSM) network, a Code Division Multiple Access 
(CDMA) network, a Time Division Multiple Access Network (TDMA), a General Packet 
5 Radio service (GPRS) network, a Third Generation network, such as a UMTS network, or the 
like. 

Alternatively or additionally, the coding device may comprise one or more 
other interfaces 504 for communicating the coded stereo signal T to the decoding device 505. 
Examples of such interfaces include a disc drive for storing data on a computer-readable 

10 medium 510, e.g. a floppy-disk drive, a read/write CD-ROM drive, a DVD-drive, etc. Other 
examples include a memory card slot a magnetic card reader/writer, an interface for 
accessing a smart card, etc. 

Correspondingly, the decoding device 505 comprises a corresponding receiver 
508 for receiving the signal transmitted by the transmitter and/or another interface 506 for 

15 receiving the coded stereo signal communicated via the interface 504 and the computer- 
readable medium 510. The decoding device further comprises a decoder 507 which receives 
the received signal T and decodes it into corresponding components L' and R' of a decoded 
stereo signal. A preferred embodiment of such a decoder according to the invention was 
described in connection with fig. 4 above. The decoding device further comprises an output 

20 unit 5 12 for outputting the decoded signals which may subsequently be fed into an audio 
player for reproduction via a set of loudspeakers, or the like. 

It is noted that the above arrangements may be implemented as general- or 
special-purpose programmable microprocessors, Digital Signal Processors (DSP), 
Application Specific Integrated Circuits (ASIC), Programmable Logic Arrays (PLA), Field 

25 Programmable Gate Arrays (FPGA), special purpose electronic circuits, etc., or a 
combination thereof. 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention, and that those skilled in the art will be able to design many alternative 
embodiments without departing from the scope of the appended claims. 

30 For example, the invention is not limited to stereophonic signals, but may also 

be applied to other multi-channel input signals having two or more input channels. Examples 
of such multi-channel signals include signals received from a Digital Versatile Disc (DVD) 
or a Super Audio Compact Disc, etc. 
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In the claims, any reference signs placed between parentheses shall not be 
construed as limiting the claim. The word "comprising" does not exclude the presence of 
elements or steps other than those listed in a claim. The word "a" or "an" preceding an 
element does not exclude the presence of a plurality of such elements. 
5 The invention can be implemented by means of hardware comprising several 

distinct elements, and by means of a suitably programmed computer. In the device claim 
enumerating several means, several of these means can be embodied by one and the same 
item of hardware. The mere fact that certain measures are recited in mutually different 
dependent claims does not indicate that a combination of these measures cannot be used to 
10 advantage. 
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1 . A method of synthesizing a first and a second output signal from an input 
signal, the method comprising: 

filtering the input signal to generate a filtered signal; 

obtaining a correlation parameter indicative of a desired correlation between 
the first and second output signals; 

obtaining a level parameter indicative of a desired level difference between the 
first and second output signals; and 

transforming the input signal and the filtered signal by a matrixing operation 
into the first and second output signals, where the matrixing operation depends on the 
correlation parameter and the level parameter. 

2. A method according to claim 1, wherein the matrixing operation comprises a 
common rotation by a predetermined angle of the first and second output signals in a space 
spanned by the input signal and the filtered input signal; and where the predetermined angle 
depends on the level parameter. 

3 . A method according to claim 2, wherein the predetermined angle is selected to 
maximize a total contribution of the input signal to the first and second output signals. 

4. A method according to claim 1, further comprising scaling each of the first 
and second output signals to said desired level difference between the first and second output 
signals. 

5. A method according to claim 1, wherein the filtering of the input signal 
comprises all-pass filtering the input signal. 

6. A method according to claim 5 ? wherein the all-pass filter comprises a 
frequency-dependant delay. 
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7. An arrangement for synthesizing a first and a second output signal from an 
input signal, the arrangement comprising: 

filter means for filtering the input signal to generate a filtered signal; 
means for obtaining a correlation parameter indicative of a desired correlation 
5 between the first and second output signals; 

means for obtaining a level parameter indicative of a desired level difference 
between the first and second output signals; 

means for transforming the input signal and the filtered signal by a matrixing 
operation into the first and second output signals, where the matrixing operation depends on 
1 0 the correlation parameter and the level parameter. 

8. An apparatus for supplying a decoded audio signal, the apparatus comprising 
an input unit for receiving an encoded audio signal; 

a decoder for decoding the encoded audio signal, the decoder comprising an 
15 arrangement for synthesizing. a first and a second audio signal according to claim 7; and 
an output unit for providing the decoded first and second audio signal. 

9. A decoded multi-channel signal comprising a first and a second signal 
component synthesized from an input signal by transforming the input signal and a filtered 

20 signal by a matrixing operation into the first and second signal components, where the 

filtered signal is generated by filtering the input signal, and where the matrixing operation 
depends on a correlation parameter indicative of a desired correlation between the first and 
second output signals and on a level parameter indicative of a desired level difference 
between the first and second output signals. 

25 

10. A storage medium having stored thereon a decoded multi-channel signal 
according to claim 9. 
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